A refined neuronal population measure of visual attention

Neurophysiological studies of cognitive mechanisms such as visual attention typically ignore trial-by-trial variability and instead report mean differences averaged across many trials. Advances in electrophysiology allow for the simultaneous recording of small populations of neurons, which may obviate the need for averaging activity over trials. We recently introduced a method called the attention axis that uses multi-electrode recordings to provide estimates of attentional state of behaving monkeys on individual trials. Here, we refine this method to eliminate problems that can cause bias in estimates of attentional state in certain scenarios. We demonstrate the sources of these problems using simulations and propose an amendment to the previous formulation that provides superior performance in trial-bytrial assessments of attentional state. Copyright

Non-Linear Population Firing Rates and Voltage Sensitive Dye Signals in Visual Areas 17 and 18 to Short Duration Stimuli

Visual stimuli of short duration seem to persist longer after the stimulus offset than stimuli of longer duration. This visual persistence must have a physiological explanation. In ferrets exposed to stimuli of different durations we measured the relative changes in the membrane potentials with a voltage sensitive dye and the action potentials of populations of neurons in the upper layers of areas 17 and 18. For durations less than 100 ms, the timing and amplitude of the firing and membrane potentials showed several non-linear effects. The ON response became truncated, the OFF response progressively reduced, and the timing of the OFF responses progressively delayed the shorter the stimulus duration. The offset of the stimulus elicited a sudden and strong negativity in the time derivative of the dye signal. All these non-linearities could be explained by the stimulus offset inducing a sudden inhibition in layers II–III as indicated by the strongly negative time derivative of the dye signal. Despite the non-linear behavior of the layer II–III neurons the sum of the action potentials, integrated from the peak of the ON response to the peak of the OFF response, was almost linearly related to the stimulus duration

Depth cues and perceived audiovisual synchrony of biological motion

Due to their different propagation times, visual and auditory signals from external events arrive at the human sensory receptors with a disparate delay. This delay consistently varies with distance, but, despite such variability, most events are perceived as synchronic. There is, however, contradictory data and claims regarding the existence of compensatory mechanisms for distance in simultaneity judgments. Principal Findings: In this paper we have used familiar audiovisual events – a visual walker and footstep sounds – and manipulated the number of depth cues. In a simultaneity judgment task we presented a large range of stimulus onset asynchronies corresponding to distances of up to 35 meters. We found an effect of distance over the simultaneity estimates, with greater distances requiring larger stimulus onset asynchronies, and vision always leading. This effect was stronger when both visual and auditory cues were present but was interestingly not found when depth cues were impoverished. Significance: These findings reveal that there should be an internal mechanism to compensate for audiovisual delays, which critically depends on the depth information available.FEDERFundação para a Ciência e a Tecnologia (FCT

Learned Value Magnifies Salience-Based Attentional Capture

Visual attention is captured by physically salient stimuli (termed salience-based attentional capture), and by otherwise task-irrelevant stimuli that contain goal-related features (termed contingent attentional capture). Recently, we reported that physically nonsalient stimuli associated with value through reward learning also capture attention involuntarily (Anderson, Laurent, & Yantis, PNAS, 2011). Although it is known that physical salience and goal-relatedness both influence attentional priority, it is unknown whether or how attentional capture by a salient stimulus is modulated by its associated value. Here we show that a physically salient, task-irrelevant distractor previously associated with a large reward slows visual search more than an equally salient distractor previously associated with a smaller reward. This magnification of salience-based attentional capture by learned value extinguishes over several hundred trials. These findings reveal a broad influence of learned value on involuntary attentional capture

Ambient light modulation of exogenous attention to threat

Planet Earth’s motion yields a 50 % day–50 % night yearly balance in every latitude or longitude, so survival must be guaranteed in very different light conditions in many species, including human. Cone- and rod-dominant vision, respectively specialized in light and darkness, present several processing differences, which are—at least partially—reflected in event-related potentials (ERPs). The present experiment aimed at characterizing exogenous attention to threatening (spiders) and neutral (wheels) distractors in two environmental light conditions, low mesopic (L, 0.03 lx) and high mesopic (H, 6.5 lx), yielding a differential photoreceptor activity balance: rod > cone and rod < cone, respectively. These distractors were presented in the lower visual hemifield while the 40 participants were involved in a digit categorization task. Stimuli, both targets (digits) and distractors, were exactly the same in L and H. Both ERPs and behavioral performance in the task were recorded. Enhanced attentional capture by salient distractors was observed regardless of ambient light level. However, ERPs showed a differential pattern as a function of ambient light. Thus, significantly enhanced amplitude to salient distractors was observed in posterior P1 and early anterior P2 (P2a) only during the H context, in late P2a during the L context, and in occipital P3 during both H and L contexts. In other words, while exogenous attention to threat was equally efficient in light and darkness, cone-dominant exogenous attention was faster than rod-dominant, in line with previous data indicating slower processing times for rod- than for cone-dominant visionThis research was supported by the Grants PSI2014-54853-P and PSI2012-37090 from the Ministerio de Economía y Competitividad of Spain (MINECO

Axonal Transmission in the Retina Introduces a Small Dispersion of Relative Timing in the Ganglion Cell Population Response

Background: Visual stimuli elicit action potentials in tens of different retinal ganglion cells. Each ganglion cell type responds with a different latency to a given stimulus, thus transforming the high-dimensional input into a temporal neural code. The timing of the first spikes between different retinal projection neurons cells may further change along axonal transmission. The purpose of this study is to investigate if intraretinal conduction velocity leads to a synchronization or dispersion of the population signal leaving the eye. Methodology/Principal Findings: We 'imaged' the initiation and transmission of light-evoked action potentials along individual axons in the rabbit retina at micron-scale resolution using a high-density multi-transistor array. We measured unimodal conduction velocity distributions (1.3 +/- 0.3 m/sec, mean +/- SD) for axonal populations at all retinal eccentricities with the exception of the central part that contains myelinated axons. The velocity variance within each piece of retina is caused by ganglion cell types that show narrower and slightly different average velocity tuning. Ganglion cells of the same type respond with similar latency to spatially homogenous stimuli and conduct with similar velocity. For ganglion cells of different type intraretinal conduction velocity and response latency to flashed stimuli are negatively correlated, indicating that differences in first spike timing increase (up to 10 msec). Similarly, the analysis of pair-wise correlated activity in response to white-noise stimuli reveals that conduction velocity and response latency are negatively correlated. Conclusion/Significance: Intraretinal conduction does not change the relative spike timing between ganglion cells of the same type but increases spike timing differences among ganglion cells of different type. The fastest retinal ganglion cells therefore act as indicators of new stimuli for postsynaptic neurons. The intraretinal dispersion of the population activity will not be compensated by variability in extraretinal conduction times, estimated from data in the literature

Testing a dynamic field account of interactions between spatial attention and spatial working memory

Studies examining the relationship between spatial attention and spatial working memory (SWM) have shown that discrimination responses are faster for targets appearing at locations that are being maintained in SWM, and that location memory is impaired when attention is withdrawn during the delay. These observations support the proposal that sustained attention is required for successful retention in SWM: if attention is withdrawn, memory representations are likely to fail, increasing errors. In the present study, this proposal is reexamined in light of a neural process model of SWM. On the basis of the model’s functioning, we propose an alternative explanation for the observed decline in SWM performance when a secondary task is performed during retention: SWM representations drift systematically toward the location of targets appearing during the delay. To test this explanation, participants completed a color-discrimination task during the delay interval of a spatial recall task. In the critical shifting attention condition, the color stimulus could appear either toward or away from the memorized location relative to a midline reference axis. We hypothesized that if shifting attention during the delay leads to the failure of SWM representations, there should be an increase in the variance of recall errors but no change in directional error, regardless of the direction of the shift. Conversely, if shifting attention induces drift of SWM representations—as predicted by the model—there should be systematic changes in the pattern of spatial recall errors depending on the direction of the shift. Results were consistent with the latter possibility—recall errors were biased toward the location of discrimination targets appearing during the delay

Predicting Decisions in Human Social Interactions Using Real-Time fMRI and Pattern Classification

Negotiation and trade typically require a mutual interaction while simultaneously resting in uncertainty which decision the partner ultimately will make at the end of the process. Assessing already during the negotiation in which direction one's counterpart tends would provide a tremendous advantage. Recently, neuroimaging techniques combined with multivariate pattern classification of the acquired data have made it possible to discriminate subjective states of mind on the basis of their neuronal activation signature. However, to enable an online-assessment of the participant's mind state both approaches need to be extended to a real-time technique. By combining real-time functional magnetic resonance imaging (fMRI) and online pattern classification techniques, we show that it is possible to predict human behavior during social interaction before the interacting partner communicates a specific decision. Average accuracy reached approximately 70% when we predicted online the decisions of volunteers playing the ultimatum game, a well-known paradigm in economic game theory. Our results demonstrate the successful online analysis of complex emotional and cognitive states using real-time fMRI, which will enable a major breakthrough for social fMRI by providing information about mental states of partners already during the mutual interaction. Interestingly, an additional whole brain classification across subjects confirmed the online results: anterior insula, ventral striatum, and lateral orbitofrontal cortex, known to act in emotional self-regulation and reward processing for adjustment of behavior, appeared to be strong determinants of later overt behavior in the ultimatum game. Using whole brain classification we were also able to discriminate between brain processes related to subjective emotional and motivational states and brain processes related to the evaluation of objective financial incentives

Combining Feature Selection and Integration—A Neural Model for MT Motion Selectivity

Background: The computation of pattern motion in visual area MT based on motion input from area V1 has been investigated in many experiments and models attempting to replicate the main mechanisms. Two different core conceptual approaches were developed to explain the findings. In integrationist models the key mechanism to achieve pattern selectivity is the nonlinear integration of V1 motion activity. In contrast, selectionist models focus on the motion computation at positions with 2D features. Methodology/Principal Findings: Recent experiments revealed that neither of the two concepts alone is sufficient to explain all experimental data and that most of the existing models cannot account for the complex behaviour found. MT pattern selectivity changes over time for stimuli like type II plaids from vector average to the direction computed with an intersection of constraint rule or by feature tracking. Also, the spatial arrangement of the stimulus within the receptive field of a MT cell plays a crucial role. We propose a recurrent neural model showing how feature integration and selection can be combined into one common architecture to explain these findings. The key features of the model are the computation of 1D and 2D motion in model area V1 subpopulations that are integrated in model MT cells using feedforward and feedback processing. Our results are also in line with findings concerning the solution of the aperture problem. Conclusions/Significance: We propose a new neural model for MT pattern computation and motion disambiguation that i

Visual Performance Fields: Frames of Reference

Performance in most visual discrimination tasks is better along the horizontal than the vertical meridian (Horizontal-Vertical Anisotropy, HVA), and along the lower than the upper vertical meridian (Vertical Meridian Asymmetry, VMA), with intermediate performance at intercardinal locations. As these inhomogeneities are prevalent throughout visual tasks, it is important to understand the perceptual consequences of dissociating spatial reference frames. In all studies of performance fields so far, allocentric environmental references and egocentric observer reference frames were aligned. Here we quantified the effects of manipulating head-centric and retinotopic coordinates on the shape of visual performance fields. When observers viewed briefly presented radial arrays of Gabors and discriminated the tilt of a target relative to homogeneously oriented distractors, performance fields shifted with head tilt (Experiment 1), and fixation (Experiment 2). These results show that performance fields shift in-line with egocentric referents, corresponding to the retinal location of the stimulus